Deriving Business Intelligence from Unstructured Data

The bulk of an organization’s data is unstructured that is the information that doesn't nicely fit into the typical data-processing format. It remains stored, but unanalysed. The information hidden or stored in unstructured data can play a critical role in making decisions, understanding and complying with regulations, and conducting other business functions. Integrating data stored in both structured and unstructured formats can add significant value to an organization. Such integrated data will define the Total Data Warehouse infrastructure so an organization can derive a single version of truth. Analyzing and processing text can reformat this data and merge it with traditional structured data for greater corporate insight. We propose to use text tagging and annotation, to derive business intelligence from business invoices of a company. After the extraction of facts and dimensions from unstructured textual data of invoices, unstructured data is transformed into a relational form and can be stored in a data warehouse. These steps offer businesses an insight into the context, or true meaning, of the unstructured text.